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- - - Abstract. We establish a spectral duality for certain unbounded operators in Hilbert space. The class 

of operators includes discrete graph Laplacians arising from infinite weighted graphs. The problem in this 
, context is to establish a practical approximation of infinite models with suitable sequences of finite models 

■ which in turn allow (relatively) easy computations. 

Let X be an infinite set and let be a Hilbert space of functions on X with inner product (■, ■) = (•, ■)^. 
^jq' We will be assuming that the Dirac masses Sj:, for x 6 X, are contained in Ti.. And we then define an 

, associated operator A in W given by 

(Av)ix):={S.,,v}^. 

' Similarly, for every finite subset F C X, we get an operator Ap. 

, If _Fl C -F2 C . . . is an ascending sequence of finite subsets such that Ufjgpj-Ff; = X, we are interested in 

the following two problems: 

(a) obtaining an approximation formula 



X 



lim Af^ = A; 



and 

• (b) establish a computational spectral analysis for the truncated operators Ap in (a). 
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1. Introduction 

The purpose of this paper is twofold: first to prove that certain linear operators associated with discrete 
reproducing kernel-Hilbert spaces exhibit spectral duality. This is motivated by more traditional Green's 
function techniques for second order elliptic differential operators. Secondly we explore applications of the 
duality theorem to discrete Laplace operators in weighted (infinite) graphs. In particular we show (for the 
discrete case) that the Green's function may be realized as an infinite matrix with entries counting length 
of paths of edges in a graph. 

There has been a recent increase in the interplay between discrete analysis and various continuous limits. 
While each topic in its own right has been studied for generations, the interconnections are of a more recent 
vintage, and they in turn have inspired a multitude of exciting new research trends. The motivations for 
this are manifold, coming in part from numerical analysis, but also more recently from analysis on fractals, 
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see e.g., |DJ07a[ lDJQ7b[ iBSUOSi [5"tr05[ IStrOG ]. from stochastic processes, from potential theory, Dirichlct 
forms [Saw97| , and discrete Laplacians on weighted graphs |JP08[ IDJ08[ IFab06j . These topics interact with 
mathe matical physics, see e.g., pPOSl IDJ081 IPow76[ IOP96j . and with signal processing [DJ07a[ IDHPSOSi 
IJor83j . But independently of applications, the same themes have an operator theoretic dimension of interest 
in its own right, see e.g., [HK LWQ7,,j0r78 ; as well as spectral theory |j0r81| . A common thread for this is the 
use of positive definite functions and reproducing kernel Hilbert spaces |BCR841 IJor891 IJorQOi IPar70[ IPS72j . 

In a variety of studies, the authors have used special subclasses of reproducing kernel Hilbert spaces 
(RKHSs), and each case appears in isolation; for example, the authors of I DC08| use RKHSs in a systematic 
study of Fredholm o perators, |FJKU05) in potential theory, |GG05L rGTHB05l IHCDBOTj in physics, |HKK07l 
IHCDBOTl IGTHB05] in signal processing, |Pre07| in statistics, and [SZ08t iTreOSj in harmonic analysis. One 
aim of the present paper is to unify these approaches. 

In this paper we take up two themes, one we call spectral reciprocity, and the other is a computational 
approximation scheme (sections [5] and [6]). Both themes interact with the various related developments 
covered in the above cited papers. 

The paper is organized as follows: In section [2] we introduce the Hilbert spaces which admit spectral 
duality. Let X be an infinite set, and let 7i be a Hilbert space of functions on X. The crucial restriction on 
the pair X,T-l is that the 5 point masses are assumed to lie in the Hilbert space 7i, (Definition (^H]) . 

The distinction between the discrete and continuous models is illustrated with examples from the theory 
of stochastic processes. In section |3] we show that the framework of graph Laplacians is included in the 
setup. Section [5] offers a way of diagonalizing these operators. The idea is analogous to a method used 
by Karhunen-Loeve (see e.g., |JS07j ). but different in that it creates finite matrix approximations to the 
operator in a global ambient Hilbert space. In section Owe study approximation: An ascending system of 
finite subsets in X is chosen with union equal to X] and we then show that the corresponding sequence of 
finite truncations converges. The last theorem identifies a rigorous Green's function for graph Laplacians. 

Thus there are two interesting and interdisciplinary links to operators in symmetric Hilbert spaces (Defi- 
nition 2.1). It is via operators in these Hilbert spaces built on infinite discrete spaces. 

Iterated function systems (abbreviated IFS, [Hut81| ) serve in two ways as a link between analysis on 
discrete systems on one side and operator theory on the other. 

Recall that IFSs generate fractal images arising in numerous applications: For example, some IFS-fractals 
may be built as limits of iterated backwards trajectories of a dynamical system associated to a fixed endo- 
morphism T : X ^ X. The generation of the fractals is via recursive procedures applied to branches of a 
choice of inverse mappings for T . As attractors, we then get limit fractal-sets and fractal measures /i. So in 
this way the Hilbert space i^(/i) arises as a limit of Hilbert spaces; starting with a graph and passing to the 
limit. 

On the discrete side, the graph G has vertices and edges G^ . The first approach (see e.g., [JPOSj l is 
to model IFSs with infinite vertex sets , and associated Hilbert spaces of functions on G^ . In the second 
approach (e.g., [KU07| ) one starts with an IFS, and then there is an associated graph G with vertex set 
a singleton, but instead with edges made up of an infinite set G^ of self-loops. 



We show that Hilbert spaces of functions which contain the corresponding 5 point masses induce operators 
arising as graph Laplacians of weighted graphs. 

The general setup in our paper is as follows: An infinite set X is given, and we consider Hilbert spaces 
of functions on X. One of the Hilbert spaces will be simply P{X). By this we mean the Hilbert space of all 
functions u : X ^ C such that 



2. Hilbert spaces of functions 



(2.1) 




If u,w e P 



{X), the inner product will be denoted 



(2.2) 
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Let T be the set of all finite subsets F C X. Then the expression in (|2.f p is by definition 
(2.3) sup V |w(x)|2. 

However because of applications, to be outlined later, for a fixed set X, it will be necessary for us to consider 
other Hilbert spaces H, of functions on X. 

Definition 2.1. Let 7i be a Hilbert space of functions on some set X. We say that 7i is symmetric if the 
Dirac functions 6x are in 7i, where 



(2.4) 4(2/) 



1 \iy = X 

ifyeX\{x}. 



For practical computations we offer in section |4] a method of finite reduction. As an application we give 
in Corollary 14.71 a necessary and sufficient condition for a Hilbert space of functions to contain its Dirac 
delta-functions (Definition 12. ip . 

We will primarily be interested in the case when the set X is countably infinite; see especially section [3] 
below where we will take X to be the set of vertices in a given weighted graph. Because of applications to 
electrical networks, see |JP0 8 and the references cited there, every weighted graph comes with an associated 
Hilbert space He- In the applications. He will denote a space of functions on the vertices of the graph, 
representing a voltage distribution; and, if u G He^ then will be the energy of the configuration 

represented by u. 

The following example is different and applies to continuous models; for example models of stochastic 
processes. 

Example 2.2. Let X = [0, 1). We will be considering functions on X modulo constants. Hence the constant 
function 1 on X will be identified with 0. If / is a function on [0, 1), the derivative /' = ^/ is understood 
in the sense of distributions. Set 

W:={/l/'ei'(0,i)}, 

(2.5) 11/11?,:= r\f'{x)fdx- and 

Jo 

(2.6) (/i , f2)n / 7{R/2(^) dx, for /i, ^ G H. 

Jo 

Note that if / G then /' G and 

(2.7) F{x) := r f'{t)dt 



is well defined. Moreover, the derivative -^F exists pointwise a.e. on [0,1). As distributions, -^F and /' 
agree. 

On [0, 1), consider the following family of functions {vx} indexed hy x & X. Set 

{y < y < X 
if 2/ < 
X if X < y. 

Writing in the sense of distributions we arrive at the following formula: 
For every / G 



(2.9) {vx,f) = / vjy)f{y)dy = f {v) dy = f{x). 



Hence £ H, and 

(2.10) {vxi , VX2) = min(a:;i; X2) — Xi A X2 for all xi,X2 G X. 

Proposition 2.3. Ti. is not a symmetric Hilbert space; i.e., if x Cz [0, 1] then Sx is not in TL. 
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Proof. The claim is that there is not a vector f E H such that 

(2.11) ^"{x) = (/ , = Tbj)^'{y) dy 

Jo 

for aU twice difFerentiable functions (p E C^[0, 1). To see that (|2.1ip is a restatement of 6x G H, note that 
v'J. — —6x holds in the sense of distributions. But note that (|2.1ip implies that there is a finite constant Cx 
such that 



\v"{x)\'<Cx / \^'{y)\'dy, i^eC'); 
Jo 

which is clearly impossible. □ 



Remark 2.4. (See Definition 12.11 the general case) The condition that Sx is in Ti for all x g X does not 
imply that P{X) is contained in H. So there are symmetric Hilbert spaces which do not contain P{X). 

Definition 2.5. If X is given, and is a symmetric Hilbert space, we set 

(2.12) {Av){x) -.^ {Sx,v)^, (ven^xeX). 

Let Fun(X) =the vector space of all functions X ^ C Then A is a linear operator from H into Fun(X). 
We set 

(2.13) dom(A) = domain oi A = {v £ H\ Av e H}, 

and we say that A is densely defined if dom(A) is dense in H. 

Let Fin = Fin(X) — all finite linear combinations of {Sx \ x G X}, i.e., all finitely supported functions on 

X. 

Definition 2.6. Let X and H be as in the previous definition. A pair of functions: X 3 x i-^ Vx E Ti. and 

X 3 X i—>- Wx Fin is said to be a dual pair if 

(2.14) {vx , u)^ = {wx , u)2 , {xeX,ue n) 

and if the linear span of {vx \ x G X} is dense in Ti.. 
A dual pair is said to be symmetric iff 



(2.15) Wx{y) = Wy{x), {x,yeX) 

Theorem 2.7. Let X,Ti. be as above, and let {vx)xex, {wx)xex be a dual pair. Let A be the operator defined 
in (|2.13p . and set V :— spanjwa; \ x & X} = all finite linear combinations. 
Then V C dom(A) and A is Hermitian on its domain V, i.e., 

(2.16) {Au , v).^ = {u , At;).^ {u, v G V). 
Moreover 

(2.17) Avx^Wx, xeX. 
Proof. We have for x,y € X, 

(Avx)[y) = [dy , Vx)j^ = {by , Wx)2 = Wx{y) 

Thus Avx — Wx G H so Vx E dom(A), and therefore V C dom(A). 
If li G dom(A), then 

(2.18) {vx , Au)„ = {wx , u).^ , {x e X). 
Indeed, 

{vx , Au).^ = {wx , Au)2 = ^ Wxiy) {Sy , Au)^ ^ Wxiy) {Sy , u).^ = {wx , m)„ . 

j/GX yeX 

So if xi,X2 G X, then 

/ A \ / \ / \ by (EH, , bydlHl) 

Since V = span{wa; | x G AT} the desired conclusion (|2.16p holds. □ 
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3. Graph Laplacians 

We show that every weighted graph G induces a Laplace operator and an energy Hilbert space of functions 
on the vertices of G; and moreover that this setup is included in that of section [2l This is then used in 
obtaining solutions to a potential theory problem on G. 

Definition 3.1. Weighted graph. 

Let G° be a set. Let C G" x G° be a subset such that {x,x) ^ G^ if x e G°. For x G G°, set 

(3.1) Nhh{x):={yeG"\{xy)eG^}. 

We say that (xy) is an edge if {xy) E G^; and the points in G" are called vertices. Further we shall use the 
notation 

(xy) e G^ ^ x ^ y 

Further assume 

(3.2) (xy) e G^ (yx) e G^ 
Let fi : G^ ^ M+ be a function such that 

(3.3) fj,{x) :— ^ fixy < oo, for all x G G°. 

y,y~x 

Further assume ^xy = l^yx for all {xy) £ G^ . 

We will assume that G ~ {G^,G^) is connected, i.e., for every pair x,y E G^ there is a finite subset 
{eg, ei, . . . , e„} C G^, depending on x and y such that = (x^Xi+i) , xq = x and a;„+i = y. 

Definition 3.2. The energy Hilbert space He- For functions u and v on G°, set 

(3.4) {u,v)j^:=]^ ^ Aia;y(M(a;) -M(2/))(w(a;) -u(2/)). 

x,y x^y 

More precisely, we will work with functions on G" modulo the constants. We say that u G He iff 

(3.5) \WfHE-=\ XI Ai2;yl"(a;) - w(?/)p < oo. 

x,y x^y 

Definition 3.3. The graph Laplacian. 

Let (G, fi) be a weighted graph. We define the graph Laplacian A — A(q initially on all functions on 
G*^ as follows 

(3.6) (AM)(a;) := ^ fixyiuix) - u(?/)) = Ai(a;)M(a;) - ^ fixyu{y). 

y^x y^x 

In section [3] we started with a symmetric Hilbert space (Definition 12. ip , and we derived an associated 
family of operators A from the Hilbert space setup. In this section, the point of view is reversed: we begin 
with a graph Laplacian A and an associated energy Hilbert space. It turns out that the class of operators 
in section 2 includes all the graph Laplacians. 

Lemma 3.4. The energy Hilbert space He associated with a weighted graph {G,fi) is symmetric, i.e., for 
all X G G*', we have S.^ G He- Moreover 

(3.7) \\Sx\\%, ^ K^y, 



(3.8) {Sx , Sy) 



-IJ-xy if x^y 

if X ^ y and (xy) ^ G^; 



and 

(3.9) iAu)ix) = {Sx , u) , 
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Proof. Let xqEG^. Then 



Let (xqUo) € G^. 



x^y 

It is clear that {Sxq , Sy^) = if xq ^ yo and (xoyo) ^ G^. 
We finally prove ([331). Let xoeG°, and let ue He- Then 



, . s / N by P.6P .r-^ / / X /XX 

(Awjixo) = 2^ ^J.xoy(u(xo) ~ u{y)) = 
y~xo 

\ ( H M:Eoy(l - O)(u(a;o) - w(y)) + Y ^^/^oC^ ~ l)("(y) " u{xo)) 



x~y 



□ 



Theorem 3.5. Let (G, /i) &e a weighted graph; let A &e the corresponding graph Laplacian, and let He be 
the energy Hilbert space. Let w : G'^ C be a function on the vertices satisfying 

(a) w E Fin(= finite linear span of {5x \ x G G*^} ); 
and 

(f>) 'ExeG° "^^ = 0- 

Then there is a v (z He such that 

(3.10) Av = w. 

Remark 3.6. Before proving the theorem, we show by a simple example that neither of the two restrictions 
(a) or (b) on the function w may be dropped. We will give examples when some function w does not satisfy 
one of the two conditions. While there will always be a function w : G" ^ C which satisfies p.lOp . the point 
is that none of the solutions v will be in He, i.e., the solutions v will have infinite energy, i.e., = oo. 

Example 3.7. Let (G, fi) = (Z, 1). By this we mean that G (G", G^) has 

r GO 

(3.11) <^ G^ ={{n,n + l)\neZ} 

[ Ai(n,«+i) = 1, ("- e Z)- 

It follows from p.6p that 

(Au)(x) = 2u{x) - u{x - 1) - u{x + 1), (a; G Z). 

The following facts are from |JP08j : 

Fact 1. The only solutions v to the equation 

(3.12) Av^O on Z 

have the form v{x) ^ Ax + a, where A and a, are constants. 
Fact 2. On Z set 



(3.13) v+{x) = 
and 

(3.14) v^{x) = 



X if a; > 
if a; < 0: 



if a; > 
—X if a; < 0. 
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Then v± ^ He, i.e., ||w±|||f^ = oo, and 

(3.15) Ai;+ = Ai;_ = -Sq. 
Combining the two facts, we see immediately that the equation 

(3.16) Av = Sq 

has no solutions in He- Note that So G Fin, but does not satisfy condition (b) in the theorem. 
The equation 

(3.17) Au = v+-v_{^x) 

on Z does not have any solutions in He- Note that the function v+ — V- on the right hand side in p.l7p 
does satisfy (b), but w+ — v- is not in Fin. 

We now turn to the proof of Theorem 13.51 The following lemma is helpful: 

Lemma 3.8. Let (G, /i) be a weighted graph, and let W denote the linear space of functions w : C 
satisfying conditions (a)-(h) in the statement of Theorem \3.5l Then 

yy = {tu G Fin I ^ 0} = span{4 ~ Sy\x,y <E G"}. 

Proof. Induction on \wx ^ 0}- □ 
Proof of Theorem \3-5[ By the lemma, it is enough to show that for any pair a;, y G G", x 7^ y, the equation 

(3.18) Av = 6^- 6y 
has a solution v G He- 

Now fix X and y in G*^. Using Riesz' lemma, we first prove that there is a unique v G He such that 

(3.19) {v , u) ^ ^ u{x) ~ u{y), {u e He) 

Since G is connected, there is a finite subset {eo, . . . , e„} C G such that = {xi, Xi^i) G G^, xo = a; and 
Xn+i = y- Then 



\u{x) - u{y)\' 



^{u{xi) - u{xi+i)) 



i=0 



n n by 

<^l^e^^l^eM{Xi)-u{x^+i)\'^ < C^y\\u\\ji^ 
i=0 i=0 



Hence the existence of a solution v in p.l9p follows from Riesz' lemma applied to He- 
We note that v satisfies (I3.18p . Indeed, for all z G G°, we have 

w.byeH),. , bydSIll) 
(Av){z) = {Oz,v}j^ = S^[x) - dz[y) ^ d:c[z) - dy{z)- 

Hence the two sides in equation p.lSp agree as functions on G", and the proof is complete. 
Definition 3.9. Positive semidefinitc- Let X be a set. Set 

(3.20) T) ■-= Fin = all finitely supported functions on X ^ {c : X ^ C \ #{x G X \ Cx ^ 0} < 00} 
A function M : X x M — > C is said to be positive semidefinite iff 

(3.21) ^c^M(x,?/)cj, > 0, (xgP). 

Theorem 3.10. (Parthasarathy-Schmidt |PS72j .) 

(a) Let Af : X X X — !■ C be a function. Then the following conditions are equivalent: 

(3.22) M is positive semidefinite. 

(3.23) There is a Hilbert space Ti. and a function v : X TL such that 

(3.24) M{x,y)^{vx,vy)^, {x,yen)- 



□ 
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(b) We say that two systems v : X ^ Ti., v' : X —t TL' in (a) are unitarily equivalent if there is a unitary 
isomorphism W : H ^ H' such that 

(3.25) Wv^^v'^, (xeX). 

(c) If V : X ^ Ti. and v' : X Ti.' are two systems both satisfying (|3.24p then v and v' are unitarily 
equivalent iff 

(3.26) span{vx \ x S X} = H, and span{?;^ | x € X} = H' . 

Corollary 3.11. Let {G,fj,) be a weighted graph satisfying the conditions in Theorem \ 3.5\ Let He be the 

energy Hilbert space and A the graph Laplacian. 

(a) For every x,y £ let Vxy be the unique solution in He to equation (j3.18p . Then for a fixed 
y, the function G*^ x G'^ —^ C, {xi,X2) '—^ {"Vxiy , Vx2y) e positive semidefinite. Moreover, the function 
(GO X G") X (G° X G") ^ C, ix,y,,x2y2) ^ { 

V2) E positive semidefinite. 

(b) Let G = [G^ , G^) be as in (a), and let fj, : G^ —* ]R_|_ be a function satisfying the conditions in Definition 
[X71 Let M = : G° X G° ^ C be 

{fj.{x) ifx = y 

-l^xy if {xy) e Gi 

if X ^ y and {xy) ^ G^ . 

Then Af^ is positive semidefinite. 

4. DiAGONALIZING SUBSYSTEMS 

It is known that positive semidefinite functions define reproducing kernel Hilbert spaces. In this section 
we identify which of these Hilbert spaces are symmetric (DefLnitioi l2.ip . And we solve the problem of 
diagonalizing finite subsystems. 

Let X be a set, and let M : X x X ^ C be a positive semidefinite function. Wc will consider solutions 
V : X ^ H to condition (|3.24p . i.e., 

(4.1) M{x,y) = {vx,vy).^, {x,yeX) 

The next result shows that when restricting to finite subsystems, {vx \ x G F}, F C X finite, we may assume 
that the set {vx)xgf is linearly independent in Ti.. 

Definition 4.1. Let M : X x X ^ C he positive semidefinite. Let £ be the space of all finite linear 
combinations 

(4.2) fci-) = J2cxMi;x) 

x£X 

Set 

(4.3) {fa , fb)n 51^*^(2;, y)6,, for fajb e C. 

x,y 

Set 

(4.4) /C {/e e £ I ^ c^M{x, y)cy - 0}, 

the kernel of M . 
Now set 

(4.5) C C/JC Hilbert completion —: Hm, 
Set 

Vx ■= M{-,x) classM(-,a::) e Hm- 
Then Vx = fs^, i.e., Vx = fc with c = 6x; and 

(4.6) {v^^f)=f(x), ifeHM). 
Indeed 

{vxo , fc) ^^Sxoix)M{x,y)c{y) ^ Af (xq, y)c(y) ^ fc{xo). 
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We refer to [Aro50| for the general theory of reproducmg kernels. 

In the analysis below, the idea is to select finite subsets F of a fixed ambient infinite set X; and it is 
assumed that 7i is a symmetric Hilbert space of functions on X. This method of finite reduction is motivated 
by computations, in that infinite sequences do not admit representations in computer registers. 

Lemma 4.2. Let M : X x X C be a positive semidefinite function, and let TLm be the Hilbert space in 
Definition Let F <Z X be a finite subset, and let Mp be the #-F x matrix 

(4.7) {M{x,y)y,,y^F- 

Then if Q is in the spectrum of Mp with eigenvector {cx)xgf, then fc in (j4.2p represents the zero vector in 
Hm- 

Proof. Follows from Definition 14.11 and (|4.5p : if {cx)x£F is an eigenvector for Mp with eigenvalue 0, i.e., 
Mp{cx)xeF — then J^y^x M{x, y)cy — for all x & F so 

^ c^M{x,y)cy=0, i.e., WfcWn,, =0. 

□ 

Remark 4.3. Since every positive semidefinite function M induces a reproducing kernel Hilbert space 
M Hm via Definition 14.11 it is important to note that the class of Hilbert spaces in Definition 12.11 are 
restricted in two ways: a symmetric Hilbert space 7i is a space of functions on a given set X and Sx (z Ti. for 
ah X e X. 

The following example shows that 7ij\/ may be obtained from a positive semidefinite function M : Xx X ^ 
C, even though Ti.M is not a space of functions on X. 



Example 4.4. |AK071 [MM\ u600\ IJor02j Let X = [0,1), and set M{x,y) = Then M is positive 

semidefinite on [0, 1). Moreover the resulting Hilbert space (Definition [41]) H-m contains Sx for all x E [0, 1). 

Let u and v be compactly supported distributions, and u(^v the tensor product {u(^ v){x,y) := u{x)v{y) 
where the right-hand side is evaluation on C°°(R^), written {u{-)v{-) , ■)/'(•, ■)), ip € C°°(R^). The ^M-inner 
product is defined by 

where the right-hand side now denotes application of the distribution Ti^v to ip{x,y) — jTTj^- 
If (Jg"-* = (t^:)" € No, are the distribution derivatives, then 

(4.8) u„ := t}}ls(^^\ (neN°) 



n 



is an orthonormal basis in Hm- Indeed, ii (p G C°°(— e, 1) for some e e M+ then ip e Hm, and the {w„} 
expansion in Hm is as follows 



and for x G (0, 1), we have 



i.e., the Taylor expansion. 



oo „ 

^(x) = (<5.,^)„^^ = X^^(")(0), 



71=0 



Remark 4.5. Because of Lemma 1421 we will assume in the sequel that when M and Mp are as described 
then is not in specp (Mp). 

Theorem 4.6. Let M : X x X C be a positive semidefinite function, and let Hm be the Hilbert space in 
Definition \4-l\ Let F d X be a finite subset, and set 

(4.9) Ap spectrump (^p-^Mp 
and 

(4.10) Hm{F) = span{vx \x e F}. 

T-Lm 
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Let (^A)AeAj!. be m ONB in P{F) satisfying 

(4.11) Mf^x = K\ on F. 
For \ ^ Kp, set 

(4.12) ^.,(.):=4f E?a(2;)«.(-). 

Then {u\)\^/yp is an ONB in T-Lm{F), and 

(4.13) = E ^^\{x)ux for all x e F. 

AsAf 

Proof. We first show that the system {u\)\^Af in (|4.12p is orthonormal in Hm- Let A, A' € Ap. Then 
{ux , ux')u^, = ^= ^^(^)^^'iy) ' ^y) = ^ff7 ^A(a;)(Mi.G')(a;) = 



V a^eF ' ■ ■ xeF 

By Lemma 1321 we see that {ux)xeAF is indeed an ONB for Hm{F) and that 

(4.14) Pp:= Y l"A)(^iA| 

AgAf 

is the orthogonal projection onto Hai{F). Note that we use Dirac's "ket-bra" notation on the right hand 



side of (|4l4)) . 

We now prove ()4.13p . For a; G F we have 



by 611 ^ ^1 Y-FTT/ \ 

Vx = PpVx = = 2^ (WA,W:r)MA= 2^ / . ^A(y) [Vy , Vx) Ux 

by gUD ^ , , ^ ^ ^ ^ , ^ 

= 2^ ^A^A(a;)'UA= 2^ VA5A(2;juA 

agAf xeAf 



by (l4T4ll 

agAf AeAj!- ^ i^eF 

xeAp ^ xeAp 

which is the desired formula (I4.13p . □ 



Corollary 4.7. Let M : X x X ^ C be a positive semidefinite function, and let TLm be the Hilbert space in 
Definition \4-l\ Choose the system {vx}xgx C Hm as in (|4.5p - (|4.6p . For every finite subset F C X, let 

(4.15) {^^{x))xeA,^xeF 

be the unitary jj=F x ^F matrix from the construction in Theorem \4.6\ Then TLm is a symmetric Hilbert 
space fDefinition \2.1\) iff 



(4.16) sup Y 



\ex{x)? 



< 00. 



Proof. Recall TLm is a symmetric Hilbert space iff 6x G TLm for all x ^ X. Assume this condition holds; and 
let G =the set of all finite subsets of X , and let xq ^ X . 
From (|4.14p . recall the formula for the projection onto TLm{F): 

AeAf- 

Since € '^Mj we have 

PfSx„ = XI ' '^^0) "a = Yj 7f 51 ^A (2;) ' ^■^o)nM "A = 

AgAf AsAf xeF 

bygH) J_^^F(^j.)Sx„{x)uf^ ^ Y -yf^xMux- 
xeAp ^A ^g^^ VA 
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< OO. 



Since {u^)xeAF is an ONB in Hm{F) by the theorem, we get 

Taking supremum over J-', the desired conclusion (|4.16p now follows. 

Conversely, suppose (|4.16p is satisfied for some vertex xq. To prove that dxg G we shall need the 
following observations which may be of independent interest. 

Observation 4.8. Let F and F' be two finite sets, and assume F C F' . Then T-Im{F) C T-Im{F')] see 
(|4.10p : and therefore 

(4.17) PfCPf', 
or equivalently 

(4.18) Pf = Pf'Pf = PfPf'- 

For the corresponding two eigenvalue sets and A^' in (|4.9p we have 

(4.19) min{A' G A^.} < min{A G A^}; 
and 

(4.20) max{A e Af} < max{A' e Af'}. 

(Note that (I4.19p - (l4.20p follow from the min-max principle in spectral theory.) 
Observation 4.9. If w e Hm, and F C F', then 

(4.21) \\Pfw\\1^ < \\PF'w\\j^ < Wwfn, 
and 

(4.22) WPfwWI,^ J2 IK'^), 



AsAf 



and 



w. 



H 



2 

_ 1 

^ A 



Eef(2^)(^x)-«^(0)) 



x£F 



x£F 

(In the application above, we used this principle to w = 5xq) The proof details here are based on Theorem 
mi Part I. 



Observation 4.10. Suppose there is a if € Hm such that 

1 



(4.23) (^ul,w)^ = ^^^{x^) 
for all F E !F, and all A <E Af; then w = S^^. 

Observation 4.11. Assume (|4.16p : then for all F G there exist some vector 6^^ G 7iji/(F) such that 

(4.24) (^f ,jfJ^ = _L^F(^, (AgAf). 

Observation 4.12. For every (Fk) C Fi C F2 C . . . such that UfeF^ — X, we have 

(4.25) hm E Tief (^o)P = sup E (^^c 631). 

AgAfj^ ^^-^AeAp 

Observation 4.13. Let {Fk)ke'M be a system in T as in Observation 14.121 and choose vectors 5^^ G TYm as 
in Observation 14.111 Then 

hm \\6^4-5^xl\\n = 0, 
and so there exists a unique w^o G Ti. such that 

A;— ^00 
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Observation 4.14. An application of Observation 14.101 shows that Wxo = Sxq', i-e., that as functions on X, 
Wxo and Sxg coincide. 

To see this, note that the existence of Wxg E H is from Observation 14.131 and that its properties follow 
from a combination of all the preceding observations. 

□ 

We conclude this section with two examples: both will be needed later, both are discrete analogues of 
Example 12.21 and both yield energy Hilbert spaces He = Hm which are symmetric Hilbert spaces. This 
means that condition (|4.16p of Corollarv l4.7l is satisfied in both examples. 

Example 4.15. (Example [377] revisited) As in Example 13.71 we take (G, /i) = (Z, 1); i.e., the graph with 
vertices G*^ — Z, and edges represented by nearest neighbors. 

Th argument in Example 13 . 71 shows that for each x G G" = Z, the equation 

(4.26) Avx ^5x-5o 

has a unique solution Vx G He, and the graph of Vx is represented in Figure [TJ for the cases x G Z+, x G Z_ 
respectively. 



■Vx x G Zj 



■Vx a; G Z^ 



If a; G Z+ then 
(4.27) 

If a; G Z_, then 
(4.28) 



Z 

Figure 1 . Vx ioi x e Z_|_ and for a; G Z_ 



if y < 

Vx{y) = { V ifO<y<a; 

X ii X < y. 

-X \i y < X 

'Vxiv) ^ { -y ifa:<y<0 

if < y. 



Z 



An application of (|3.4p in Definition 13.21 now yields 

{min(a;i, a;2) = a;i A 2:2, ifa;i,a;2GZ+ 
\xi\ A |a;2| if a;i,a;2 G Z_ 
if xi G Z-|_ and a::2 G Z_. 

Hence a typical submatrix Mp constructed by restriction to F x F from 



(4.30) 

see Lemma [4.21 has the form 



(4.31) 



or a submatrix thereof. 



M{x,y) = {vx , Vy) 



VIE 



/111 

1 2 2 
1 2 3 



1 2 3 
V 1 2 3 



1 \ 

2 

3 



n — 1 n — 1 
n n J 
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Example 4.16. f |DJ08[[JP08] ) We take (G, /i) = (tree, 1); i.e., the graph with vertices G° =the dyadic tree, 
see Figure [2] The empty word has two neighbors and 1; and ah other finite words x = {luiuj2 . . .LOk), 




Figure 2. Go = the dyadic tree. 

uJi G {0, 1} have three neighbors 

(4.32) (^10^2 . . . iOk-i), ii0iuj2 ■ ■ ■ t^feO) and (wiW2 ■ • ■ ti^fcl) 

written x* , (xO) and (xl). 

With /i = 1, the Laplace operator A is (see p.6p ) 

(Aw)(0) = 2u(0)-u(O)-u(l), 

and 

(4.33) (Au)(a;) = 3u{x) - u^x*) - uixO) - u{xl). 
For a; e G° \ {0}, the equation 

(4.34) {v, , u) ^ ^ u{x) - u{9) 

has the unique solution G He given as follows: There is a unique path V{x) of edges leading from to x: 
(0,tt'i), {u>i,u!iUJ2), . . . , (^1 . . .u!k-2,x*), {x*,x); see Figure [3] Then Vx{y) =the length of the path common 
to V{x) and Viy), so 

vM = #{V{x)r\V{y)). 
For the positive definite function M in (|4.ip we now get 




iJlUJ2 

Figure 3. Vix) 



(4.35) M{x,y) = {vx,Vy)^^#{V{x)r\V{y)), (x, y e G" \ {0}); 
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i.e., the length of the path common to Vlx) and Vd/). 

Hence a typical submatrix Mp constructed from (|4.35p by restriction to F x F has the following form: 
Figure ID 








1 


00 


01 


10 


11 


000 


001 


010 


Oil 


100 


101 


110 


111 





1 





1 


1 








1 


1 


1 


1 














1 





1 








1 


1 














1 


1 


1 


1 


00 


1 





2 


1 








2 


2 


1 


1 














01 


1 





1 


2 








1 


1 


2 


2 














10 





1 








2 


1 














2 


2 


1 


1 


11 





1 








1 


2 














1 


1 


1 


2 


000 


1 





2 


1 








3 


2 


1 


1 














001 


1 





2 


1 








2 


3 


1 


1 














010 


1 





1 


2 








1 


1 


3 


2 














oil 


1 





1 


2 








1 


1 


2 


3 














100 





1 








2 


1 














3 


2 


1 


1 


101 





1 








2 


1 














2 


3 


1 


1 


110 





1 








1 


2 














1 


1 


3 


2 


111 





1 








1 


2 














1 


1 


2 


3 



Figure 4. Mp for F = {0, 1, 00, ... , 111} 



Remark 4.17. The spectral theory of Mp appears to be difhcult in general, but if 

F = Fk = {xeG''\ l{x) =k} = {x\x = {uji... ojk), ^^ e {0, 1}} 

then M^fc := Mp may be generated recursively. 

Let A = (ai j) be an rt x n matrix and set T{A)i j := a^j + 1. Then 



M, 



fe+i 



T{Mk) 
T{Mk) 



(4.36) 



Mi^i I J ),M2 = 



2 1 ^ 

12 

2 1 

V 1 2 y 



, etc; see Figure HI 



Set Afc = spectrum;2 (Mfc); then 
(4.37) 



minAfc = 1, and maxA^ = 2'^' — 1. 



Observation 4.18. Denoting the vertices in as in Figure [U we get the following relations for the two 
systems of vectors {Sx\x G G^} and {v^ \x G G^}: 



(4.38) 
and 

(4.39) 



2fc 



2''- - 1 



H !)■ 
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Proof. From (|4.36p . we see that := maxAp^, has multiphcity 2 for all A; e N. Wc may pick two 

normalized eigenvectors t^'' £ P{Fk): 



( 1 \ 

1 



1 






and " 



/ \ 







1 
1 

V 1 ) 



The other eigenvectors f^*" in P(Fk) corresponding to A < 2"^ — 1 satisfy (^a , Xf^)i2 — 0. 
By Theorem 14.61 and the observations following Corollary 14. 7l we get 

xeAf 



2*^-1' 



Indeed by ()4.14p . we have 



see (|4T2l) . and ([i^g]) follows. 



-{u 



Fk 



F,. ■ 



□ 



5. The truncated operators PpAPp 



In the general framework of section [2] and [3] we introduced symmetric Hilbert spaces Ti. and associated 
operators A. We proved (Theorem 13. 5|) that the setup includes the most general class of graph Laplacians 
for weighted graphs (G,/i). In the latter case, the symmetric Hilbert space is = Hp — the energy Hilbert 
space of Definition 13.21 In all cases, we show that the Hilbert space under consideration is associated with 
a positive definite function 

(5.1) M{x,y) = {v^,Vy)^ 

where {vx \ x £ X} is a system of vectors in H, and H = spEn{vx \ x £ X}; see Theorem 13.101 Further 
we show that it is possible to choose the family {vx)xex such that each Vx is in the domain of A, i.e., 
Vx £ dom(A) for all x £ X; see Theorem 13.51 and Lemma \3M 

In section SI we reduced the study of operators A in 7i to its finite truncations. Specifically, for each 
finite subset F d X, we introduced in Theorem 14.61 the orthogonal projection Pp onto 

(5.2) n{F) := spa.n{vx \x £F}. 

H 

When F is given, let {uf | A G A^} be the ONE in HiF) introduced in (|4.12p . Then with Dirac's notation, 
we have 

(5.3) 



It follows from (|4.12p that each is in dom(A); and as a result that the finite-rank truncations 

(5.4) Pp/^Pp 

are well defined. For fixed F, the matrix with respect to the ONB {u^ | A G A^?} is 

(5.5) K,A^f,)„ 

where A is a row-index, and A' a column index. 

The purpose of this section is to approximate A with its finite truncations PpAPp. To do this use some 
chosen nested system 

(5.6) FiCF2C...FkC---cX 
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such that 
(5.7) 

With that choice 
(5.8) 

and we wish to study the corresponding Hmit 
(5.9) 
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hm Pp^ = In, 

k — >oo 



hm Pp.APi 



5.1. Graph applications. In view of Lemma it is practical to select a base point £ G", and for each 
a; g choose the unique solution G He to 

(5.10) {v^ , u)j^ = u{x) - u(0), (u € He). 
Recall (Theorem 13. 5p . in this case 

(5.11) Av^ = 5^- 6o, ixeG"\ {0}. 
Before turning to the approximation (j5.9p . we prove the following 

Lemma 5.1. Let (G, /i), A, G G°, He, {vx\x e G" \ {0}} be as described above, and let C G° \ {0} be a 
finite subset. Then 



(5.12) 

(5.13) 

and 
(5.14) 

(5.15) 



PfSq = - V 4t ' 
Ate VA 

IIP i|2 I , Xf)i2 ? 

\\PfOo\\He - : 

AsAf 



PpAPp is a rank-1 perturbation of the diagonal operator 



Dp 



( 

A^^ 



\ 




V ••• A-i / 

where Ap = {Ai, A2, . . . , A„y } with eigenvalues counted with repetition according to multiplicity. 
Proof. Ad 

PfSo= Y1 (""a : <5o) = 7f XI ^A (2;) K ' '5o)isUA = 



AeA_F ^ x£F 



- ^ ^A (2^)"A = - 2^ ^ (Ca : Xf);2 Wa : 



agAf ^ xeF xeAp 
which is (I5.12p . Note that (|5.13p is immediate from this by Parseval 
Ad (|5.14p . We compute the matrix representation (|5.5p 



F ^ by 6111) 1 



/XX 



-J E ef(x)ef.(y)(^^., 



by (EH]) 



y/ E 



x,yeF 



x,yGF 



x.y^F 



*A,A'+«.-PFio){Pf«0,«J> 
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which is the A, A'-cocfhcicnt of the operator 

/ X~' 



An 



V 



\PfSo){Pf5o\ 



Kl J 



□ 



Remark 5.2. The function in ^JU\), 

(5.16) M{xi,X2) = xi AX2, a;i,a;2 € [0, 1) 

is the continuous analogue of the discrete version (|4.35p . And (|4.35p in turn is a special case of (|4.ip . i.e., 

(5.17) Mix,y)^{v,,vy)^ 

valid for the most general Hilbert space Ti.. 

The purpose of Lemma lS.ll is to obtain a discrete version of a Green's function for A. To see how Lemma 
15.11 compares to the classical case, Example 12.21 note that if (/3 e C^[0, 1] and (p'{l) = then 

(5.18) / V?"(y)(yAa;)dy = (^(0)~(p(x). 

"'0 

As is known, the function in (|5.16p is the Green's functions for A ~ and we think equation (|5.18p as 

a continuous variant of our formula (|3.18p - p.l9p in Lemma \WM 

The idea is that ii H — He from a graph Laplacian A of a weighted graph (G, /i) , then the function 
A/(-, •) in (|5.17p is the Green's function for A. 

5.2. Boundedness. In this subsection we study an intriguing interrelationship between the family of ma- 
trices Alp on the one hand, and the Laplace operator A on the other. The operator A will be considered in 
the energy Hilbert space He- While boundedness may be easily discerned when A is viewed as an operator 
in P, this is not the case when the ambient Hilbert space is He- The result below is the assertion that 
boundedness is equivalent with the presence of a spectral gap for the system of matrices Mp ■ Note that in 
Example 14. 161 the matrix Alp encodes agreement in the comparison of finite words (a Google matrix), and 
the result therefore yields spectral data for the Google matrix as a consequence of operator theory of A. 

The information carried in Lemma 15.11 suggests a "spectral reciprocity" . For each finite subset F C 
G° \ {0}, the operator 



Dp = 



( 









An 



\ 





V ••• A-i , 
encodes the numbers {A^^ | A G Ap}. We proved the formula 
(5.19) PpAPp = Dp + \PpSo){PpSol 

where PpAPp is a "matrix-corner" of the infinite dimensional operator A. Specifically, PpAPp arises from 
A as 



(5.20) 



A = 



PpAPp PpAP^ 



where Pp 
(5.21) 



P^APp P^AP^ 

I-j-i — Pp is the projection onto the orthocomplement 

n{F)^ := H e n{F) = {u G H | = O for aU v £ n{F)}. 

The last term in (|5.19p is a rank-1 operator, i.e., Rp = \up){up\, up := Pp6q. Equivalently 

(5.22) Rp - ||ui.||^P„^ 

where Pup — the projection onto Cup ~ the 1-dimensional space spanned by up. 
Hence, for the operator norm Rp : Ti —f Ti., we have 

(5.23) 



\Rp\\h~.h - sup{\\Rpu\\H I \\u\\n = 1} = ||uf||w. 
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Setting V := spa,n{vx | x G \ {0}} = all finite linear combinations, we get 

(5.24) lim Pf5o = 

F—*oc 

and 

(5.25) lim \uf){uf\ = \6o){So\. 

F^oo 

Corollary 5.3. Let Fi d F2 d . . . be an ascending family of finite sets satisfying (|5.6p - (|5.7p . It follows that 

(5.26) lim Df,=A + \\Sq\\^^Ps, on V. 

k — >oo 

Proof. By (|5.26p we mean that the limit 

(5.27) lim {u , Df^v)^ = {u , Aw)„ + {u , 60) {Sq , v) 

k — >oo 

is valid for all w, u e V. 

But this conclusion is contained in Lemma |5. II and the discussion above. 

□ 

Corollary 5.4. Let (G, /i),0 G G°, A andH. = He he as above. Set 

(5.28) M{x,y)^{vx,Vy)^, a;,yeG"\{0}, 
and 

(5.29) MF.= M\Fy.F- 

Then 

(5.30) := inf min{A € Af} > 
if and only if A is a bounded operator He He . 

Proof. Suppose Sa > 0. Let F e T, and let u e 7i(F). Then by Lemma [SH 

{u , Au)„ = {u , Dfu)^ + I , PF6o)n ? < 5a'II"II« + ||^^||?,||Pf<5o||?, < {S^' + \\So\\'n)\Wfn- 
Since A is Hermitian, this implies boundedness; and 

(5.31) l|A||w^^= sup {u, Au) <5^' + \\Sof^. 

uev,\\u\\-H=i 

Note that (j5.3ip yields an a priori bound on the norm of A. 

Conversely, suppose A is a bounded operator. Since the limit (I5.27P exists, and 

\\DF\\n^H max{A"^} = — — —y , 

we have Sa > {\\A\\-]-c^n)^^ and the conclusion follows. □ 

5.3. Application. In Example 14.161 we introduced the matrix (|4.35p M{x,y) := #(7'(x) n V{y)), as a 
measure of agreement of sets of words represented by the paths to x as compared to y. 

One may compute the spectrum of Mf for all finite subsets F <Z \ {0}, but it is difficult to directly 
compute the spectral gap number 5a in (|5.30p for this example. 

Hence as an application of our spectral representation of A in /^(G), or in He from |DJ08j . we can show 
that \\A\\ue^He < oo- 

Theorem 5.5. |DJ08[ Theorem 3.26] Let /ic be the semicircular measure on [—1, 1] 

d^c = 

and let ^J-c+p be the measure on [—1, 1] given by 



2 

djic = — \/~\~-xP' dx , 

TT 



* — 
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Let Mc+p be the operator of multiplication by 3 — 2^/2x on L^{iJ,c+p), and the operator of multiplication 
by 3 — 2y/2x on L^(/ic). Then the Laplacian A : P ^ P is unitarily equivalent to the multiplication operator 

(5.32) Mc+p ® ®n=iMc on L^ifi^+p) ® (B^^^L^ific)- 

So, as an application of Corollary 5.3, we get the following 

Corollary 5.6. Let (G, fi) — (tree, 1) be the graph in Example \4-.16\ and let (5a be the number (j5.30p for this 
example. Then Sa > 0; i.e., there is a spectral gap in the Google matrix; see Figure^ 

Proof. In view of Corollarv l5.4| we must show that A from Example 14. 161 i.e., {G,ii) = (tree, 1) is bounded 
in He; that A : He He is a bounded operator. The boundedness of A : P — > P is contained in the 
spectral representation (|5.32p in Theorem 15. 51 Indeed there is unitary equivalence W : P L^([— 1, 1], z^, /C) 
where is the spectral measure and K. P is the Hilbert space which accounts for multiplicity; and W 
satisfies 

(5.33) WA = (3 - 2V2x)W. 
It follows that the quadratic form 

(5.34) Jj3~2V2x)mx)\\ld,y{x)=:ml^^,^^) 
extends u s- ||7i|||f^. Setting Wu = u = ip, we get 

\\Au\\l^ = jj3~2V2x)\\{3~2V2x)u{-)\\ldv{x) < 3^ j j3~2V2x)\\u{x)\\ldv{x) = %u\\1^l^^,) - %u\\l^. 

Hence, \\A\\nE^HE < 3. □ 

Corollary 5.7. Let (G, /i),0 S G", A, and Ti, = He be as in Corollary \5.4\ As an operator A : He He, 
there is a bounded inverse if and only if 

(5.35) a — sup max{A G Kp} < oo. 

Proof. By Lemma 15. 1[ invertibility of A : He — > He is decided by the presence of a global a priori bound 
on the operators (PfAPf)^^ as F ranges over T. If cr in (|5.35p is finite, then 

sup\\Ap^\\he^He < <^^^ 

F 

where A^ := PpAPp. And conversely. □ 

Corollary 5.8. The operator A in Example \4.16\ (i.e., (G, /i) — (tree,!)) and Corollary \ 5. 6\ does not have 
a bounded inverse. 

Proof. Follows from (|4.37p in Remark 14.171 □ 

6. The Green's function 

In this section we prove that the semidefinite functions introduced in section [5T51 serve as Green's functions 
for graph Laplacians. 

We treat the general case of the function 

G° xG°3 {x,y) ^ Mix,y) = {v^ , Vy) 

from (|5.28p . and we show that it is analogous to the standard Green's function for A in the continuous case; 
see Example 12.21 and Remark [ 



Theorem 6.1. Consider the function M (•, x) associated with a fixed weighted graph (G, fi) with graph Lapla- 
cian A. The action of A on this function will be denoted A.M(-,x) where the dot represents the action 
variable. Then 

-{A.M{;x)){y) = 4,, + 1 - t^{y)M{y,x). 

Remark 6.2. We have restricted the variables x, y to G'^ \ {0} where is a chosen fixed base point in G°, 
and where we make the convention Vx{0) = 0, for all .x G G° \ {0}. 
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Proof of Theorem \6.1[ For x,y ^ \ {0} we have 

-(A. A/(., ^ M,.(M(z, x) - M{y, x)) ^ , _ y,{y)M{y, x) = 

z~y zr^v 

by gjH) ^^^^ , t)^)^ - ^i{y)M{y, x) ((Jj^ - , v^) ^ - Ky)M{y, x) ^ S^y + 1 - fi{y)M{y, x). 

□ 

In the third step of the computation we used the foUowing lemma. 
Lemma 6.3. For points in G'^ \ {0}, we have the following identity 
(6.1) y^^Uxzjvx - Vz) = '^Vx- 

Proof Let y £ G° \ {0} then 

/ Wj, , ^ Hxz{Vx - Wz) ) = fl{x)Vy{x) - ^ tixzVy{z) = 

\ Z^X I ^ Zr^X 

{Avy){x) = (Sy - Sq){x) = dxy = {Av^){y) = {vy , Av^)^ . 
Since spanjwj^ \ y E \ {0}} is dense in He, the desired conclusion (|6.ip follows. □ 
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